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Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

Listing of Claims: 

1. (Original) A method of recognizing a frame in a document image, comprising: 

inputting document image data; 

extracting a black pixel rectangle that circumscribes continuous black pixels, the 
black pixel rectangle defining a parent rectangle; 

determining whether or not the parent rectangle is a frame candidate based upon 
a predetermined set of first criteria; 

extracting a white pixel rectangle that circumscribes continuous white pixels 
within the parent rectangle of the frame candidate; and 

further determining whether or not the frame candidate is a frame based upon a 
predetermined set of second criteria, the second criteria including at least a comparison of 
a certain aspect between the white pixel rectangle and the black pixel rectangle. 

2. (Original) The method of recognizing a frame in a document image according to claim 
1 wherein the predetermined set of the first criteria includes a comparison of one side of 
the black pixel rectangle to a first predetermined threshold value. 

3. (Original) The method of recognizing a frame in a document image according to claim 
1 wherein the predetermined set of the first criteria includes a comparison of a ratio of 
sides of the black pixel rectangle to a second predetermined threshold value. 

4. (Original) The method of recognizing a frame in a document image according to claim 
1 wherein the predetermined set of the first criteria includes a comparison of a black pixel 
density of the black pixel rectangle to a third predetermined threshold value. 
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5. (Original) The method of recognizing a frame in a document image according to claim 
1 wherein the predetermined set of the second criteria includes additional steps of: 

comparing a center difference in center position between the white pixel 
rectangle and the black pixel rectangle to a fourth predetermined threshold value; and 

recognizing the frame candidate as a frame if the center difference is equal to or 
smaller than the fourth predetermined threshold value. 



6. (Original) The method of recognizing a frame in a document image according to claim 
1 wherein the predetermined set of the second criteria includes additional steps of: 

determining a pixel value difference in coordinates of each of corresponding 
four corners between the white pixel rectangle and the black pixel rectangle; 

further determining a max-to-min difference between a maximal value of the 
pixel value differences and a minimal value of the pixel value differences; 

comparing the max-to-min difference to a fifth predetermined threshold value; 

and 

recognizing the frame candidate as a frame if the max-to-min difference is equal 
to or smaller than the fifth predetermined threshold value. 

7. (Original) The method of recognizing a frame in a document image according to claim 
1 wherein the predetermined set of the second criteria includes additional steps of: 

determining a pixel value difference in coordinates of each of corresponding 
four corners between the white pixel rectangle and the black pixel rectangle; 

further determining a ruled line difference between each of the pixel value 
differences and a predetermined ruled line thickness; 

comparing the ruled line difference to a sixth predetermined threshold value; 

and 

recognizing the frame candidate as a frame if the ruled line difference is equal to 
or smaller than the sixth predetermined threshold value. 
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8. (Original) The method of recognizing a frame in a document image according to claim 
7 wherein the predetermined set of the second criteria includes additional steps of: 

determining whether or not any one of the pixel value differences is zero if the 
ruled line difference is larger than the sixth predetermined threshold value, a matched 
side being defined as a side for the pixel value difference being zero; 

determining whether or not a ruled line exists on the matched side if the pixel 
value difference is zero; and 

recognizing the frame candidate as a frame if the ruled line exists on the 
matched side. 

9. (Original) The method of recognizing a frame in a document image according to claim 
1 wherein the predetermined set of the second criteria includes additional steps of: 

generating a histograms of the length of the continuous black pixels; 

assuming a width of a ruled line based upon a median value in the histogram; 

determining a pixel value difference in coordinates of each of corresponding 
four corners between the white pixel rectangle and the black pixel rectangle; 

determining a line thickness difference between the pixel value difference and 
the assumed width of the ruled line; 

comparing the line thickness difference to a seventh predetermined threshold 
value; and 

recognizing the frame candidate as a frame if the line thickness difference is 
equal to or smaller than the seventh predetermined threshold value. 

10. (Original) The method of recognizing a frame in a document image according to 
claim 9 wherein the predetermined set of the second criteria includes additional steps of: 

determining whether or not any one of the pixel value differences is zero if the 
ruled line difference is larger than the sixth predetermined threshold value, a matched 
side being defined as a side for the pixel value difference being zero; 
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determining whether or not a ruled line exists on the matched side if the pixel 
value difference is zero; and 

recognizing the frame candidate as a frame if the ruled line exists on the 
matched side. 

1 1 . (Original) The method of recognizing a frame in a document image according to 
claim 1 wherein the predetermined set of the second criteria includes additional steps of: 

generating a histograms of the length of the continuous black pixels; 

assuming a width of a ruled line based upon a median value in the histogram; 

determining a pixel value difference in coordinates of each of corresponding 
four corners between the white pixel rectangle and the black pixel rectangle, the pixel 
value difference being defined as an eight threshold value; 

comparing a double width that is twice the width of the ruled line to the eight 
threshold value; 

comparing the pixel value difference to eight threshold value plus five if the 
eight threshold value is smaller than the double width; 

determining whether or not any one of the pixel value differences is zero if the 
pixel value difference is smaller than the eight threshold value plus five, a matched side 
being defined as a side for the pixel value difference being zero; 

determining whether or not a ruled line exists on the matched side if the pixel 
value difference is smaller than eight threshold value plus five; and 

recognizing the frame candidate as a frame if the ruled line exists on the 
matched side. 

12. (Original) The method of recognizing a frame in a document image according to 
claim 1 wherein the predetermined set of the second criteria includes additional steps of: 

generating a histogram of the length of the continuous black pixels; 
assuming a width of a ruled line based upon a median value in the histogram; 
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determining a pixel value difference in coordinates of each of corresponding 
four corners between the white pixel rectangle and the black pixel rectangle, the pixel 
value difference being defined as an eight threshold value; 

comparing a double width that is twice the width of the ruled line to the eight 
threshold value; 

comparing the pixel value difference to eight threshold value plus five if the 
eight threshold value is smaller than the double width; 

determining whether or not any one of the pixel value differences is zero if the 
pixel value difference is smaller than the eight threshold value plus five; and 

recognizing the frame candidate as a frame if any one of the pixel value 
differences is not zero. 

13. (Original) The method of recognizing a frame in a document image according to 
claim 1 further comprising: 

integrating into a single area the frames as determined by the first and second 
criteria and the frame candidates as determined by the first criteria but not by the second 
criteria based upon a common orientation of the frames and the frame candidates; 

selecting one of the frame candidates at a time; and 

determining whether or not the selected one of the frame candidates is a frame 
based upon a predetermined set of third criteria. 

14. (Original) A computer readable medium storing a computer program for recognizing 
a frame in a document image, the computer program providing computer instructions to 
perform the following steps of: 

inputting document image data; 

extracting a black pixel rectangle that circumscribes continuous black pixels, the 
black pixel rectangle defining a parent rectangle; 

determining whether or not the parent rectangle is a frame candidate based upon 
a predetermined set of first criteria; 
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extracting a white pixel rectangle that circumscribes continuous white pixels 
within the parent rectangle of the frame candidate; and 

further determining whether or not the frame candidate is a frame based upon a 
predetermined set of second criteria, the second criteria including at least a comparison of 
a certain aspect between the white pixel rectangle and the black pixel rectangle. 

15. (Currently Amended) A system for recognizing a frame in a document image, 
comprising: 

an input uni tdevice for inputting document image data; 

a black pixel rectangle extraction uni tdevice connected to said input uni tdevice 
for extracting a black pixel rectangle that circumscribes continuous black pixels, the 
black pixel rectangle defining a parent rectangle; 

a first determination uni tdevice connected to said black pixel rectangle 
extraction unit device for determining whether or not the parent rectangle is a frame 
candidate based upon a predetermined set of first criteria; 

a white pixel rectangle extraction uni tdevice connected to said first 
determination uni tdevice for extracting a white pixel rectangle that circumscribes 
continuous white pixels within the parent rectangle of the frame candidate; and 

a second determination uni tdevice connected to said black pixel rectangle 
extraction uni tdevice and said white pixel rectangle extraction uni tdevice for further 
determining whether or not the frame candidate is a frame based upon a predetermined 
set of second criteria, the second criteria including at least a comparison of a certain 
aspect between the white pixel rectangle and the black pixel rectangle. 

16. (Currently Amended) The system for recognizing a frame in a document image 
according to claim 15 wherein said first determination unit device compares one side of 
the black pixel rectangle to a first predetermined threshold value. 
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17. (Currently Amended) The system for recognizing a frame in a document image 
according to claim 15 wherein said first determination uni tdevice compares a ratio of 
sides of the black pixel rectangle to a second predetermined threshold value. 

18. (Currently Amended) The system for recognizing a frame in a document image 
according to claim 15 wherein said first determination uni idevice compares a black pixel 
density of the black pixel rectangle to a third predetermined threshold value. 

19. (Currently Amended) The system for recognizing a frame in a document image 
according to claim 15 wherein said second determination unrtdevice compares a center 
difference in center position between the white pixel rectangle and the black pixel 
rectangle to a fourth predetermined threshold value recognizes the frame candidate as a 
frame if the center difference is equal to or smaller than the fourth predetermined 
threshold value. 

20. (Currently Amended) The system for recognizing a frame in a document image 
according to claim 15 wherein said second determination un kdevice determines a pixel 
value difference in coordinates of each of corresponding four corners between the white 
pixel rectangle and the black pixel rectangle, said second determination tmi tdevice further 
determining a max-to-min difference between a maximal value of the pixel value 
differences and a minimal value of the pixel value differences, said second determination 
un rtdevice comparing the max-to-min difference to a fifth predetermined threshold value, 
and said second determination tmi tdevice recognizing the frame candidate as a frame if 
the max-to-min difference is equal to or smaller than the fifth predetermined threshold 
value. 

21. (Currently Amended) The system for recognizing a frame in a document image 
according to claim 15 wherein said second determination un kdevice determines a pixel 
value difference in coordinates of each of corresponding four corners between the white 
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pixel rectangle and the black pixel rectangle, said second determination uni tdevice further 
determining a ruled line difference between each of the pixel value differences and a 
predetermined ruled line thickness, said second determination unit device comparing the 
ruled line difference to a sixth predetermined threshold value, and said second 
determination unitdevice recognizing the frame candidate as a frame if the ruled line 
difference is equal to or smaller than the sixth predetermined threshold value. 

22. (Currently Amended) The system for recognizing a frame in a document image 
according to claim 21 wherein said second determination unitdevice further determines 
whether or not any one of the pixel value differences is zero if the ruled line difference is 
larger than the sixth predetermined threshold value, a matched side being defined as a 
side for the pixel value difference being zero, said second determination uni tdevice 
determining whether or not a ruled line exists on the matched side if the pixel value 
difference is zero, and said second determination uni tdevice recognizing the frame 
candidate as a frame if the ruled line exists on the matched side. 

23. (Currently Amended) The system for recognizing a frame in a document image 
according to claim 15 wherein said second determination uni tdevice generates a 
histogram of the length of the continuous black pixels, said second determination 
uni tdevice assuming a width of a ruled line based upon a median value in the histogram, 
said second determination uni tdevice determining a pixel value difference in coordinates 
of each of corresponding four corners between the white pixel rectangle and the black 
pixel rectangle, said second determination unit device further determining a line thickness 
difference between the pixel value difference and the assumed width of the ruled line, 
said second determination uni tdevice comparing the line thickness difference to a seventh 
predetermined threshold value, and said second determination uni tdevice recognizing the 
frame candidate as a frame if the line thickness difference is equal to or smaller than the 
seventh predetermined threshold value. 
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24. (Currently Amended) The system for recognizing a frame in a document image 
according to claim 23 wherein said second determination tmitdevice determines whether 
or not any one of the pixel value differences is zero if the ruled line difference is larger 
than the sixth predetermined threshold value, a matched side being defined as a side for 
the pixel value difference being zero, said second determination uni tdevice determining 
whether or not a ruled line exists on the matched side if the pixel value difference is zero, 
and said second determination tmi tdevice recognizing the frame candidate as a frame if 
the ruled line exists on the matched side. 

25. (Currently Amended) The system for recognizing a frame in a document image 
according to claim 15 wherein said second determination tmi tdevice generates a 
histograms of the length of the continuous black pixels, said second determination 
tmi tdevice assuming a width of a ruled line based upon a median value in the histogram, 
said second determination tmi tdevice determining a pixel value difference in 
coordinates of each of corresponding four corners between the white pixel rectangle and 
the black pixel rectangle, the pixel value difference being defined as an eight threshold 
value, said second determination tmi tdevice comparing a double width that is twice the 
width of the ruled line to the eight threshold value, said second determination tmi tdevice 
comparing the pixel value difference to eight threshold value plus five if the eight 
threshold value is smaller than the double width, said second determination tmi tdevice 
determining whether or not any one of the pixel value differences is zero if the pixel 
value difference is smaller than the eight threshold value plus five, a matched side being 
defined as a side for the pixel value difference being zero, said second determination 
tmi tdevice determining whether or not a ruled line exists on the matched side if the pixel 
value difference is smaller than eight threshold value plus five, and said second 
determination tmi tdevice recognizing the frame candidate as a frame if the ruled line 
exists on the matched side. 
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26. (Currently Amended) The system for recognizing a frame in a document image 
according to claim 15 wherein said second determination uni tdevice generates a 
histograms of the length of the continuous black pixels, said second determination 
uni tdevice assuming a width of a ruled line based upon a median value in the histogram, 
said second determination uni tdevice determining a pixel value difference in 
coordinates of each of corresponding four corners between the white pixel rectangle and 
the black pixel rectangle, the pixel value difference being defined as an eight threshold 
value, said second determination uni tdevice comparing a double width that is twice the 
width of the ruled line to the eight threshold value, said second determination uni tdevice 
comparing the pixel value difference to eight threshold value plus five if the eight 
threshold value is smaller than the double width, said second determination uni tdevice 
determining whether or not any one of the pixel value differences is zero if the pixel 
value difference is smaller than the eight threshold value plus five, and said second 
determination uni tdevice recognizing the frame candidate as a frame if any one of the 
pixel value differences is not zero. 

27. (Currently Amended) The system for recognizing a frame in a document image 
according to claim 15 further comprising: 

an imaginary continuous frame area generation uni tdevice connected to said 
first determination uni tdevice and said second determination uni tdevice for integrating 
into a single area the frames as determined by the first and second criteria and the frame 
candidates as determined by the first criteria but not by the second criteria based upon a 
common orientation of the frames and the frame candidates; and 

a frame recognition processing uni tdevice connected to said imaginary 
continuous frame area generation uni tdevice for selecting one of the frame candidates at a 
time and determining whether or not the selected one of the frame candidates is a frame 
based upon a predetermined set of third criteria. 

28. CNew) A device for recognizing a frame in a document image, comprising: 
an input unit for inputting document image data; 
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a black pixel rectangle extraction unit connected to said input unit for extracting 

a black pixel rectangle that circumscribes continuous black pixels, the black pixel 
rectangle defining a parent rectangle: 

a first determination unit connected to said black pixel rectangle extraction unit 

for determining whether or not the parent rectangle is a frame candidate based upon a 
predetermined set of first criteria: 

a white pixel rectangle extraction unit connected to said first determination unit 

for extracting a white pixel rectangle that circumscribes continuous white pixels within 
the parent rectangle of the frame candidate: and 

a second determination unit connected to said black pixel rectangle extraction 

unit and said white pixel rectangle extraction unit for further determining whether or not 
the frame candidate is a frame based upon a predetermined set of second criteria, the 
second criteria including at least a comparison of a certain aspect between the white pixel 
rectangle and the black pixel rectangle. 

29. (New) The device for recognizing a frame in a document image according to claim 28 
wherein said first determination unit compares one side of the black pixel rectangle to a 
first predetermined threshold value. 

30. (New) The device for recognizing a frame in a document image according to claim 28 
wherein said first determination unit compares a ratio of sides of the black pixel rectangle 
to a second predetermined threshold value. 

31. (New) The device for recognizing a frame in a document image according to claim 28 
wherein said first determination unit compares a black pixel density of the black pixel 
rectangle to a third predetermined threshold value. 

32. (New) The device for recognizing a frame in a document image according to claim 28 
wherein said second determination unit compares a center difference in center position 
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between the white pixel rectangle and the black pixel rectangle to a fourth predetermined 
threshold value recognizes the frame candidate as a frame if the center difference is equal 
to or smaller than the fourth predetermined threshold value. 

33. (New) The device for recognizing a frame in a document image according to claim 28 
wherein said second determination unit determines a pixel value difference in coordinates 
of each of corresponding four corners between the white pixel rectangle and the black 
pixel rectangle, said second determination unit further determining a max-to-min 
difference between a maximal value of the pixel value differences and a minimal value of 
the pixel value differences, said second determination unit comparing the max-to-min 
difference to a fifth predetermined threshold value, and said second determination unit 
recognizing the frame candidate as a frame if the max-to-min difference is equal to or 
smaller than the fifth predetermined threshold value. 

34. (New) The device for recognizing a frame in a document image according to claim 28 
wherein said second determination unit determines a pixel value difference in coordinates 
of each of corresponding four corners between the white pixel rectangle and the black 
pixel rectangle, said second determination unit further determining a ruled line difference 
between each of the pixel value differences and a predetermined ruled line thickness, said 
second determination unit comparing the ruled line difference to a sixth predetermined 
threshold value, and said second determination unit recognizing the frame candidate as a 
frame if the ruled line difference is equal to or smaller than the sixth predetermined 
threshold value. 

35. (New) The device for recognizing a frame in a document image according to claim 34 
wherein said second determination unit further determines whether or not any one of the 
pixel value differences is zero if the ruled line difference is larger than the sixth 
predetermined threshold value, a matched side being defined as a side for the pixel value 
difference being zero, said second determination unit determining whether or not a ruled 
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line exists on the matched side if the pixel value difference is zero, and said second 
determination unit recognizing the frame candidate as a frame if the ruled line exists on 
the matched side. 

36. (New) The device for recognizing a frame in a document image according to claim 28 
wherein said second determination unit generates a histogram of the length of the 
continuous black pixels, said second determination unit assuming a width of a ruled line 
based upon a median value in the histogram, said second determination unit determining 

a pixel value difference in coordinates of each of corresponding four corners between the 
white pixel rectangle and the black pixel rectangle, said second determination unit further 
determining a line thickness difference between the pixel value difference and the 
assumed width of the ruled line, said second determination unit comparing the line 
thickness difference to a seventh predetermined threshold value, and said second 
determination unit recognizing the frame candidate as a frame if the line thickness 
difference is equal to or smaller than the seventh predetermined threshold value. 

37. (New) The device for recognizing a frame in a document image according to claim 36 
wherein said second determination unit determines whether or not any one of the pixel 
value differences is zero if the ruled line difference is larger than the sixth predetermined 
threshold value, a matched side being defined as a side for the pixel value difference 
being zero, said second determination unit determining whether or not a ruled line exists 
on the matched side if the pixel value difference is zero, and said second determination 
unit recognizing the frame candidate as a frame if the ruled line exists on the matched 
side. 



38. (New) The device for recognizing a frame in a document image according to claim 28 
wherein said second determination unit generates a histograms of the length of the 
continuous black pixels, said second determination unit assuming a width of a ruled line 
based upon a median value in the histogram, said second determination unit determining 
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a pixel value difference in coordinates of each of corresponding four corners between the 
white pixel rectangle and the black pixel rectangle, the pixel value difference being 
defined as an eight threshold value, said second determination unit comparing a double 
width that is twice the width of the ruled line to the eight threshold value, said second 
determination unit comparing the pixel value difference to eight threshold value plus five 
if the eight threshold value is smaller than the double width, said second determination 
unit determining whether or not any one of the pixel value differences is zero if the pixel 
value difference is smaller than the eight threshold value plus five, a matched side being 
defined as a side for the pixel value difference being zero, said second determination unit 
determining whether or not a ruled line exists on the matched side if the pixel value 
difference is smaller than eight threshold value plus five, and said second determination 
unit recognizing the frame candidate as a frame if the ruled line exists on the matched 
side. 



39. (New)- The device for recognizing a frame in a document image according to claim 28 
wherein said second determination unit generates a histograms of the length of the 
continuous black pixels, said second determination unit assuming a width of a ruled line 
based upon a median value in the histogram, said second determination unit determining 
a pixel value difference in coordinates of each of corresponding four corners between the 
white pixel rectangle and the black pixel rectangle, the pixel value difference being 
defined as an eight threshold value, said second determination unit comparing a double 
width that is twice the width of the ruled line to the eight threshold value, said second 
determination unit comparing the pixel value difference to eight threshold value plus five 
if the eight threshold value is smaller than the double width, said second determination 
unit determining whether or not any one of the pixel value differences is zero if the pixel 
value difference is smaller than the eight threshold value plus five, and said second 
determination unit recognizing the frame candidate as a frame if any one of the pixel 
value differences is not zero. 
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40. (New) The device for recognizing a frame in a document image according to claim 28 
further comprising: 

an imaginary continuous frame area generation unit connected to said first 

determination unit and said second determination unit for integrating into a single area 
the frames as determined by the first and second criteria and the frame candidates as 
determined by the first criteria but not by the second criteria based upon a common 
orientation of the frames and the frame candidates: and 

a frame recognition processing unit connected to said imaginary continuous 

frame area generation unit for selecting one of the frame candidates at a time and 
determining whether or not the selected one of the frame candidates is a frame based 
upon a predetermined set of third criteria. 

41. (New) An apparatus for recognizing a frame in a document image, comprising: 
an input means for inputting document image data: 

a black pixel rectangle extraction means connected to said input means for 

extracting a black pixel rectangle that circumscribes continuous black pixels, the black 
pixel rectangle defining a parent rectangle: 

a first determination means connected to said black pixel rectangle extraction 

means for determining whether or not the parent rectangle is a frame candidate based 
upon a predetermined set of first criteria: 

a white pixel rectangle extraction means connected to said first determination 

means for extracting a white pixel rectangle that circumscribes continuous white pixels 
within the parent rectangle of the frame candidate: and 

a second determination means connected to said black pixel rectangle extraction 

means and said white pixel rectangle extraction means for further determining whether or 
not the frame candidate is a frame based upon a predetermined set of second criteria, the 
second criteria including at least a comparison of a certain aspect between the white pixel 
rectangle and the black pixel rectangle. 
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42. fNew) The apparatus for recognizing a frame in a document image according to claim 
41 further comprising: 

an imaginary continuous frame area generation means connected to said first 

determination means and said second determination means for integrating into a single 
area the frames as determined by the first and second criteria and the frame candidates as 
determined by the first criteria but not by the second criteria based upon a common 
orientation of the frames and the frame candidates: and 

a frame recognition processing means connected to said imaginary continuous frame area 
generation means for selecting one of the frame candidates at a time and determining 
whether or not the selected one of the frame candidates is a frame based upon a 

predetermined set of third criteria. 
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